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G. OLAFSSON 

Abstract. Wavelet and frames have become a widely used tool in mathematics, physics, 
and applied science during the last decade. In this article we discuss the construction of 
frames for _L^(]R") using the action of closed subgroups H C GL(n,]R) such that H has 
an open orbit O in M" under the action {h,ijj) ^ {h^^)'^{oj). If H has the form ANR, 
where A is simply connected and abelian, N contains a co-compact discrete subgroup 
and R is compact containing the stabilizer group of w G O then we construct a frame 
for the space Lq(R") of L'^-functions whose Fourier transform is supported in O. We 
apply this to the case where = H and the stabilizer is a symmetric subgroup, a case 
discussed for the continuous wavelet transform in jH|. 



Introduction 

The wavelet transform, and more generally time frequency analysis, has become a widely 
used and studied tool in mathematics, physics, engineering, and applied science during 
the last decade. One of the interesting aspect is the role played by abstract harmonic 
analysis and representation theory of locally compact groups. In wavelet theory one 
studies square integrable representations of semidirect products G = MJ^ Xg H, and in 
time frequency analysis representations of the Heisenberg group are used to understand 
Gabor frames build from a lattice F C M^'*. In this article we will discuss frames built 
from the continuous wavelet transform and discrete subsets T of G. 

In the language of representation theory the continuous wavelet transform on the line 
is given by taking the matrix coefficients of the natural representation vr of the {ax + b)- 
group, i.e., the group of dilations and translations on the line, on the Hilbert space L^(R). 
Thus 

7i{a,b)ij{x) = lal^i/^^ (^~) = TbDa^ix) 

and 



(0.1) W4f)ia,b) = if I nia,b)^) = \a\-'^' [ f{x)^{^)dx. 
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Here : L^(R) — ^ L^(]R) stands for the unitary isomorphism corresponding to translation 
Tbf{x) = f{x — b) and Da ■ L^(]R) — > L^(R) is the unitary map corresponding to dilation 
DJ{x) = \a\-^/'fix/a),a=^0. 

The discrete wavelet transform is obtained by sampling the wavelet transform, given by 
a suitable wavlet of a function / at points gotten by replacing the full {ax + 6)-group 
by a discrete subset generated by translation by integers and dilations of the form a = 2": 

= 2"/2 f f{x)ij{2^x + m) dx. 
Jr 

Hence, the corresponding frame is 

(0.2) {7r((2",m)-^)V I n,m G Z}. 

The inverse refers here to the inverse in the {ax + 6)-group. 

This observation, in particular (jO.lj) is the basis for the generalization of the continuous 
and discrete wavelet transform to higher dimensions and more general settings. For the 
continuous wavelet transform the relation to representation theory of the {ax + 6)-group 
was already pointed out by Grossmann, Morlet, and Paul in 1985 fHl EI- Since then 
several people have worked on wavelets related to actions of topological groups acting on 
M". Without trying to be complete we would like to name the work of Ali, Antoine, and 
Gazeau, 0121; Bernier and Taylor Fiir and Fiihr and Mayer ^TJEIEIE]; and finally 
Laugesen, Weaver, Weiss, and Wilson In most of these cases the group generalizing 
the {ax + 6)-group is a semidirect product M" Xs H, where if is a closed subgroup of 
GL(n,R). For the continuous wavelet transform one often assumes that the group H has 
open orbits Oi, . . . ,Or such that the complement of their union has measure zero. As a 
further condition for the existence of wavelet functions, or admissible functions, one needs 
that for uj in an open orbit the stabilizer 

H'^ = {heH\ {h-Y{uj) = 00} 

is compact. In |8j the case where this condition is not satisfied were discussed. Instead 
it was assumed that H is reductive, = H, and that the stabilizer group if" is a 
symmetric subgroup, i.e., there exits an involutive automorphism t : H ^ H such that 
C H'^ C H'^. For any given open orbit O we then able to construct a group Q = 
ANR C H such that the following holds: 

(1) There exists points uq, . . . ,ujk E O such that the Q-orbits Oj = Q^{ujj), < j < k, 
are open and O \ {Oi U . . . Ok) has measure zero. 

(2) The group Q has the form ANR where A is simply connected and abelian, is 
simply connected and unipotent, and R is compact and containing the stabilizer 
of ujj, < j < k. In particular the stabilizer of Uj in Q is compact. 

Our aim in this article is to use the special structure of the group Q = ANR listed 
abouve, to construct frames for L^(]R") generalizing ()U.2j) . Our ideas are based on the 
article |1] by Bernier and Taylor , but it should be pointed out that seveal of the ideas 
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in 13] are based on privious work of others. We would like to mention the article by 
Daubechies, Grossmann, and Meyer [7j, the work of Feichtinger and Grochenig [TTH IT^. 
Al, Antoine, and Gazeau |21I3]; and finally the work of Heil and Walnut |18j . 

In jl] the authors considered a subgroup H C GL(n, M) as above and assume that 
H acts freely on M", i.e., the stabilizer group is trivial. Define an action of H on M" 
by a ■ X = (a~^)-^(x). The authors introduced the notion of separated sets and frame 
generators. A separated set F is a subset of H such that there exist a compact set B G O, 
B° 7^ 0, such that a- B Hb- B ^ implies that a = b. In particular all the translates a^B, 
a eT, of B are disjoint. A frame generator is a pair (F, F) where T (Z H is separated and 
F is a compact subset of O such that IJaer ^'^ = O. In ^ the author show, that if (F, F) is 
a frame generator, then there exist a function %p and a discrete set {v{m) G M" | m G Z"} 
such that the set {7r((a, f (m))~^)^/' | a G F,m G Z"} is a frame for the Hilbert space of 
L^-functions whose Fourier transform is supported in O. 

In the first part of this article we show that the same construction can be carried out if 
the action is not free, but the stabilizer group is compact. Motivated by the construction 
in jH] we apply this to groups of the form ANR as in (2) above except we do not need to 
assume that N is simply connected. The assumption needed is, that N contains a discrete 
subgroup F such that F\A^ is compact. In this case we can carry out the construction by 
Bernier and Taylor to get a frame related to an open AN R-oihii, c.f. Theorem 14. II and 
Theorem 14.21 We recall in section 4 the construction from [S] and explain it using the 
action of GL (n,M) on the space of symmetric matrices. 

Then author would like to thank C. Heil and G. Weiss for helpfuU comments and 
corrections. 

1. Separated sets 

Let if be a closed subgroup of GL(n, R). Then H acts in a natural way on M". We 
will also consider the action 

{h,v) ^h-v:= {h-Y{v) 

of H on M". Here denotes the transpose of the matrix a G GL(?t,,M). We denote 
by 6 : R" —>■ M.^ the homomorphism 6{h) = {h~^)^ . For simplicity we will also write 
= 6{h). We assume that there exist an open orbit O C R" under the twisted action 
(/i, v) H-> h\v). ¥oi u eO let 

H"^ := {he H \ h -00 = 00} 

be the stabilizer of uo in H . Notice that H'^ = {h E H \ h^{v) = v} as is a subgroup 
of H. Because of the applications that we have in mind, we assume from now on that H'^ 
is compact. The following definition is from 0: 

Definition 1.1. Let if be a locally compact Hausdorff topological group acting on the 
locally compact Hausdorff topological space X. A subset F C ii is called separated if 
there exist a compact set S C X such that B° ^ ^ and /i • i? fl /c • i? = for all /i, /c G F, 
h ^ k. We then say that F is separated by B. 
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Example 1.2. Let H — R+SO(n). Let A C SO(n) be a non-empty subset and let A > 1. 

r := {A^i I A; e Z, a e ^} . 
Let < q; < /? be such that \a> (3 and define 

B ^{v eW \ a< \\v\\ < (5). 
Then B is compact with non-empty interior. If 6 = e F then 

6 • S = {t; e I A-'^a < ||^;|| < . 
Suppose that A; < m and that A*^SO(n) ■ Sn A"'SO(n) • B. Then X'^a < X'^^p and, hence, 

A"-^a < /3 

which is only possible if m — /c = 0. It follows that F is separated by B. 

Fix from now on ujq & O and recall that we are assuming that L := {h E H \ /i^(cJo) = 
ujq} is compact. Wc can always assume that G B° . Otherwise take h E H such that 
6 • Wo e 5°. Thus a;o = ■ B. Let F' := Th and 5' := ■ B. Then for /i, A; G F, /i 7^ /c 
we have 

{hh) ■ (b-^ ■ B) n {kh) ■ {h-^ ■B)^h-Br]k-B^$ 
so that F' is separated by B'. 

Lemma 1.3. Let L — {h E H \ h^{uJo) = Uq} and let k : H ^ O he the map h h^{oJo) 
that defines an H -isomorphism H/L ~ O. Let B <Z O he compact. Then B :— k''^{B) C 
H is a right L-invariant compact suhset of H such that k{B) — B. Furthermore the 
following holds: 

(1) uoq E B if and only if e E B; 

(2) B° if and only if B" ^ 0; 

(3) If B" then n{B") = B° and B° is right L-invariant. 

Proof. All of this is well know, but let us go over the argument here. That BL — B 
follows from the fact that K.{ab) = a^{i<i{b)) = (ah) ■ luq. 

(a) follows by K,{e) = uq. 

(b) and (c) follows from the fact that k is open and continuous. 

Wc can assume that e E B. Then L (Z B. Let K C be an open neighborhood of e 
such that V is compact. Then k{V) G O is open and 

Be \Jg-K{V). 
Hence, there are finitely many gi, . . . ,gn such that 

n 

BG\JgrK{V). 
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Let S := W^^igjV. Then S is compact and B C k{S). It follows that B C SL. But SL is 
compact as the continuous image of the compact set S x L G H x H under the continuous 
map H X H —>■ H , {a,b) \—>- ah. As B is closed it follows that B is compact. □ 

Lemma 1.4. Let V d H he a separated set. Let D d O he compact. Let S = k^^{D). 
Then for each a eT: 

#{6 G r I a ■ D n 6 ■ ^ 0} = #{6 G r I a5 n 65 ^ 0} . 

Proof. We have 

K{aSnhS) = a\D)nh\D). 

Hence, if aS* fl feS* 7^ then a^{D) fl W{D) 7^ and it follows that the right hand side is 
greater or equal to the left hand side. Assume now that x G a^{D) fl W{D). Then there 
exists s,t E S such that K{as) = K,{ht). Hence, there exist h E L such that as = hth. As 
SL = 5* it follows that aS HhS ^ and, hence, 

#{6 G r I a ■ n 6 ■ D ^ 0} < #{6 G r I a5 n 65 ^ 0} 

finishing the proof. □ 

We have now the necessary tools to prove the main results of this section. 

Theorem 1.5. Suppose that T G H and that B G O. Let B = k,^^{B). Then T is 
separated hy B in O if and only of T is separated by B in H under the natural action of 
H on H given by left multiplication. 

Proof. We have already seen that B is compact with B° non-empty. Assume that aB fl 
hB ^ ^ for some a, 6 G F then it follows by Lemma fl. 41 that a ■ B (Ih ■ B 7^ 0. Hence, a = h 
as r is separated hy B. □ 

Theorem 1.6. Suppose that T G H is a separated subset of H . Let D G O be compact. 
Then 

sup Gr|/i-DnA;-D^0}<cx). 
fcer 

Proof. This has been proved in for the case where the action of H is free. Using 
Lemma 11.41 and Theorem 11.51 the general statement is reduced to that case and, hence, 
the claim. □ 



2. The continuous wavelet transform 

In this section we review some basic facts about the continuous wavelet transform on 
with respect to a group action, see [HI El for more information and references. 
Denote by Aff(M") the group of invertable affine linear transformations on R". Then 
Aff(R") consists of pairs (x, /i) such that h G GL(n, M) and x G M". The action of 
(x, h) G Aff (M") on R'^ is given by 

(x, h){v) = h{y) + X . 
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The product is the composition of maps. Thus 

{x,a){y,b) = {a{y) +x,ab) 

and the inverse of (x, a) G Aff (M") is given by 

(x,a)^^ = (— a^^(x), a~"^) . 

Thus Aff(]R") is the semidirect product of the abehan group M" and the group GL(n, M); 
Afr(R") = R" X, GL(n,M). 

Define a unitary representation of Aff(M") on L^(M") by 

(2.1) [n{x,a)f]{v) = \det{a)\-'/'f{{x,ar\v) = \det{a)\-'/'f{a-\v-x)). 
For / G L^(M") denote by / the Fourier transform of / 

We denote by if{x, a) the unitary action on L^(M"') given by 

7r(x, a)fiv) = v/|det(a)|e-*(^l'^V(a''(t;)) = V| det(a)|e-*(^l'^V(a-' ■ v) . 
The Fourier transform intertwines the representations vr and if [jSj, Lemma 3.1: 
Lemma 2.1. Lei / G ^^(M") and (x, a) G Aff(R"). T/ien 

7r(x,a)/(u;) = 7r{x,a)f{u) . 

Let if C GL(?7,, R) be a closed subgroup. Denote by G := R" if the subgroup of 
Aff (R") given by 

G = {{x,a) G Aff(R") \ aeH}. 

We assume that there exists open sets {Oj}j^j, where J is a finite or countably infinite 
index set, such that 

(Wl) Each Oj is invariant and homogeneous under the action of H given by (a, v) ^ 

a ■ V = a^{v); 
(W2) We have n = if z j; 

(W3) The complement of UjgjOj has measure zero with respect to the Lebesgue measure 
on R". 

For a measureable function / denote by Supp(/) the complement of the maximal open 
set f/ C R" such that f{x) = for almost all x G ?7. For 7^ f/ open in R" denote by 
L^(R") the closed subspace of L^(R") given by 

(2.2) LliW) = {fe L\W) I Supp(/) C U} . 

Suppose that U is iL-invariant under the twisted action h-v = h^{v), then bv l2.1l it follows 
that L^(R"') is G-invariant. Furthermore, by Theorem 3.4 in jS], L^(R") is irreducible if 



(27r)"/2 
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and only if U is homogeneous. Hence, the decomposition of L^(R") into irreducible parts 
is given by 

(2.3) L2(R")^0L^^,(M"). 

Denote by dh a left invariant Haar measure on H. Then a left invariant Haar measure on 
G is given by dg = (27r)^"| det{a)\^^dadv. 

Definition 2.2. Suppose that 7^ f/ is an open subset of MJ^. Then a nonzero function 
/ G L^.(]R") is called admissible if T(gj{h) := [g \ Tr{x,a)f) is in L'^iG) for all g G 

A simple calculation, see |B], shows that 

(2.4) / |(^ I vr(a:,a)/)p-^^ = (2vr)" / |^(c.)p / |/>^(c.))p rfMc. 
Jg |det(a)| 

In particular, if U is homogeneous, then Cj = |/(/i^(co'))p dh is independent of G f/ 
and, hence, 

|(^ I 7r(x,a)/)p-^^^ = CfWgf. 
G \det{a}\ 

In particular / is admissible if and only ii H 3 h ^ f{hFuj) G C is in L'^[H), which in 
particular implies that the condition 

(W4) For all G f/ we have that H'^ = {h e H \ h'^ (to) = 00} is compact 

has to be satisfied. 



3. Separated sets and Frames 

In this section we recall some basic facts from jl] on how to construct frames from 
the continuous wavelet transform using separating sets. Let us also recall that we are 
assuming that H C GL (n,M) is closed and that (9 is a homogeneous open subset of M" 
such that the condition (W4) is satisfied. 

Let us start with the well known definition: 

Definition 3.1. Let H be a Hilbert space. A sequence {fn} in H is called a frame if 
there exits numbers A,B>0 such that for all f G H we have 

A\\v\\^ <J2\i^ \ ^n)\^ < B\\vf . 

n 

The numbers A and B are called frame bounds. 



The following definition is a simple generalisation of the definition by Bernier and Taylor 
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Definition 3.2. Let if be a locally compact Hausdorff topological group acting transi- 
tively on the locally compact Hausdorff topological space X. A frame generator is a 
pair (r, F) where F is a countable separated subset of H and F is a compact subset of X 
such that 



(3.1) X=|Ja-F. 



In our case we will take X = O or X = H. Notice (|3.1|) implies in this case that F° 7^ 
and that for each a G T we have #{6 Gr|a-Fn6-F7^0}<oo. Notice also that (T, F) 
is a frame generator for the action on O if and only if (F, /t~^(F)) is a frame generator for 
the action of H on H by multiplication. 

Let us now go back to the situation considered in the previous sections. Let (F, F) be 
a frame generator, let D G O be compact subset of O such that F C D°. Let R C MJ^ 
be a parallelepiped such that D G R. Choose aj < bj {j = 1, . . . ,n) and a basis Vj G M" 
{j = 1, . . . ,n) such that 

n 

Let Wi, . . . ,Wnhe the dual base to f 1, . . . , f„, i.e., (f j | Wj) = Sij. For m = (mi, . . . , m„) G 
define w{m) G M" by 

Finally we define : M" ^ C by 



^ ^ m 



'J 



w[m] := > — 



1 



VVol(/?) ^ 

where xf denotes the indicator function of a set F C M". We identify with its 
restriction to R. Then {em}m&Z" is an orthonormal basis for L'^{R). Let 

a := sup #{6 G F I a ■ n 6 ■ L> ^ 0} . 

aer 

Then a is finite by Lemma fl. 61 Let G ^^(R") be such that: 

(Fl) Supp(^) C D; 

(F2) aiip) :=inf^eF|<^(^)| >0; 

(F3) b{^) := sup^go \ip{uj)\ < 00. 

In particular we could take (f such that = Xw- 

Theorem 3.3 (Bernier- Taylor). Assume that (F,F) is a frame generator and that ip G 
LqCR"-) satisfies the conditions (Fl), (F2), and (F3). Then, with the above notation, the 
sequence 

{7r((a, w(m))~^)<^}(a,m)grxZ" 
is a frame for L'^q{W^) with frame bounds A = yol{R)a{ip)'^ and B = Vo\{R)ab{(p)'^ . 
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Proof. See [^^, Theorem 3. □ 

Example 3.4. Let H = R+SO(n) as in Example II. 21 Then H has two orbits, {0} and 
C := M" \ {0} in R". Notice that L^(M") = ^^(M") in this case. If m G O and r ^ 1 then 
ru ^ u and, hence, H"^ is a closed subgroup of SO(n) and therefore compact. In fact it 
is easy to see that is isomorphic to SO (n — 1) for aX\ uo E O. Thus all the conditions 
(Wl) - (W4) are fuUfilled. 

Let A > 1 and let F = {A" | n G Z}. Then F is separated by example 11.21 Choose 
p < a such that Xp < a and define F = {f G M" | p < \\v\\ < a}. Let v E O. Then there 
exist an n G Z such that A"p < ||f || < X^-^^p < X^a. Hence, v G A~"F = F ■ F. Thus 
(F, F) is a frame generator. 

Example 3.5. In this example we consider a case of a subgroup H C M"^SO(l,'n,) acting 
on R""*"^ which is more complicated than the example 13.41 But our construction relies on 
the fact that the action on each of the open orbits is free, i.e., the stabilizer is trivial. 
For A G R* = {r G R I r 7^ 0}, t G M, and X G R""^ define a(A, t),n{x) G GL(n + 1, R) 

by 

/cosh(t) sinh(t)' 
a(A,t) = A 

\sinh(t) cosh(t) 



and 



and let 



"1 I 1 1 1 ,>-. 1 1 2 rpT _1 1 1 , 1 1 2 

2 ' ' ' ' 2 1 1 

n{x) = I X I„_i X 

^ I I 'T' I I ^ T 1. I I -T" I I ^ 

2 1 1 1 1 2 ^ ^ I 



A := {a(A,t) I A > 0,t G R} and N = {n{x) \ x e W"-^} . 

Then A and are abelian groups. But calculations are in fact easier using the corre- 
sponding Lie algebras, which are abelian and isomorphic to R^, respectively R""^. For 
that let 



T 

X 



H{s,t) = sln+i + s{Ein+i + En+ii) and X{x) = \ X 



T 

-X 

where x G R"~^ and E^^ = {SiuSj^)ij. Define 

= {H{s, t) I s, t G R} ~ R^ and n = {X{x) \ x G R""^} ~ R""^ 
Denote by 

X^exp(X)=e^ = 5^ — 

j=o ^■ 

the matrix exponential function. Then 

e^(^'*) = a(e^^) and e^(") = . 
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Furthermore exp : a ^ A and exp : n ^ N is a, group homomorphism, i.e., in both 
cases we have e^+^ = e^e^ {X,Y e a or X, y e n), hence, the multiphcation in A, 
respectively, N can be reduced to the usual addition in R^, respectively ]R"~^. 
A simple calculation shows that 

a{X,t)n{x)a{X,t)~^ — n{e~^x) . 

In particular it follows that H = AN = NA is a closed subgroup of GL (n + 1 , M) with N a 
normal subgroup. Next we notice that a{X,ty — a{X,t)~^ — a{X~^, —t), n{x)~^ — n{—x), 
and 

/l + i||a;f -x^ -l\\xf 
n{x)^ — n{—xY — —X In-i X 

\ — 1 I 'T* I I ^ rpT "1 _1 I I ™ I I 2 

\ 2^1 1 1 2^1 I 

Hence, the twisted action of a(A, and n{x) is given by 

a(A, t) ■ V — X~^{cosh.(t)vi — sinh(t)i>„+i, i>2, . . . , — smh{t)vi + cosh(t)i>„_|_i)'^ 

and 

1 1 /''"^ \ 

n{x) - V^V+ivi-Vn+lji^Wxf.-X^.-WxfY- \^^^XjVj+ij (1,0, ...,0,1)^. 

In particular, if we take v = ei and v = e„+i, where is the standard basis of M", 

we get 

n(x)a(X,t) ■ ei = A"-^(cosh(i) + -e*a;'^, - sinh(i) + 

and 

n(x)a(X, t) ■ 6,1+1 = A^"^(— sinh(t) — — e*x"^, cosh(t) ^ll^^lP)"^ • 

Notice that the stabilizer of ei and e„+i is trivial. Let /3 be the bilinear form 

n+l 

(3{v,w) — ViWi — VjWj . 

We can now describe the four open if-orbits: 

01 = {veW^^\(3(v,v)>0,vi>0}^H-ei 

02 = {ve I P{v, v)>0,vi<0}^H- (-ei) 

03 = {ve I <0,Vi< Vn+l} = • en+i 

04 = {^^ e I P(v, v) <0,vi> Vn+i} = H ■ (-e„+i) 
The complement of Ci U • • • U C4 is given by 

\ (Oi U • • • U O4) = e R"+^ I v) = 0} U e | < 0, = v^+i} 
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which obviously has measure zero in W\ Thus (Wl) - (W4) holds. Notice also, that if we 
allow A to take positive and negative values, i.e., replace H by the non-connected group 
{a(A, t) \ XeR*,te R}N; then there are only two open orbits, Oi U O2 and O3 U O4. 
Define now 

= {exp{H{n, m)) \ n,m ^ Z,} and Fjv = {expX(a;) | x e IT'} . 
Then Ta and Fjv are discrete subgroups of A respectively N and N/T^ is compact. Let 

(3.2) r:=r^r^c//. 

Then F is a discrete subset of H, but notice that F is not a group. For e > denote by 

B^^{x e R"~^ I \\x\\ < e} . 

Choose < 5 < 1/4 such that e*Si/2 C S3/4 for all t e [-5, 5]. Then e*Z"-i n B1/2 = {0} 
for all |i| < 5. Let 

B = {a(e', t)n{x) | |s| < 1/4, \t\ < 5, x e B1/2} . 

Then B C H is compact and B° ^ ill. Let a, 6 e F and assume that aB fl 65 7^ 0. Then 
there exists a{e'^ ,t)n{x),a{e'^ ,u)n{y) G B, such that aa(e'', t)n(a;) = ba{e'^ , u)n{y) . Write 
a = a(e"% mi)n(mi) and b = a(e"'2, m2)n(m2) with nj, rrij e Z, and m.j e Z**"^ (j = 1, 2). 
Then we have 

aa(e'', i)n(x) = a(e"'^"'"'', mi + t)n(e'"mi + x) 
= ba{e'^ , u)n{y) 

= a(e"'+'', m2 + M)n(e''m2 + y) . 

But this is only possible if 

Ui + r = n2 + s, nil +t = m2 + s and e'^'mi + x = e*'m2 + y . 

But then ni — n2 = s — r G Zn[— 1/2, 1/2] = {0} and, hence, rii = n2 and s = r. Similarly 
it follows that mi = 1712 and t = u. Thus 

e^mi + X = e''m2 + y 

or 

e"(mi - 1112) = y - ,t G e' Z^'-^ n B1/2 = {0} 
which implies that mi = m2 and y = x. In particular it follows that F is separated by B 
in H. Let a;i = Ci, a;2 = —62, = e„+i and CU4 — — e„+i. For j' = 1, 2, 3, 4 the map 

H 3 Kj(g) ■— h^{ojj) — h ■ Uj E Oj 

is a diffeomorphism such that Hj{ab) = a ■ Hj{b). It follows that F is separated by Bj :— 
Kj{B) (j = l,...,4). 
For j = 1, . . . , r let 

¥j = Kj{{a{e', t)n{x^) \ \s\ < 1, \t\ < 1, \xk\ < 1 (A; = 1, . . . , n - 1)}) . 

Then a simple calculation shows that (F, F^) is a frame generator. 
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Example 3.6. Let if be a locally compact Hausdorff topological group, and assume 
that there exist a countable discrete subgroup T G H such that r\H is compact. Then 
there exist a compact subset K G H such that e G K", K^^ = | k G K} = K 

and = {ab | a, 6 G K} (IT = {e}. Assume that a, 6 G F and aK fl bK ^ 0. Then 
b~^a G -ft'^ n r = {e} and therefore a = b. It follows that T is separated by K. As r\if 
is compact there exist ¥ G H such that FF = H. Thus (F, F) is a frame generator. 

Assume now that H G GL(n, M) is closed and that (9 C is an open orbit. We 
assume that there exist u E O such that F fl H'^ = {e}. Let, as usual, k : H ^ O he 
the canonical map K{a) = a^{uj) = {a~^)'^{uj). Then F is separated by I? = n{K) and 
(F, k{¥)) is a frame generator. We would expect that by modifying the proof of Theorem 3 
in ^ one can remove the condition that Fflif^ = {e}, which would give several examples 
of reductive groups acting on M". The question is also, if one can remove the condition 
that H'^ is compact, by F fl H'^ is finite and one assumes that r\G/H'^ is compact. 

4. Action of some special groups and frame generators 

There are natural examples where M" contains finitely many open orbits satisfying 
(Wl) - (W3) but some of which do not have compact stabilizers. In |8j it was shown 
that in the case where H is reductive, or more simply stated, = H and the stabilizer 
L = H'^, cij G O, is a symmetric subgroup of H, then one can always find a subgroup 
Q = RAN = ANR such that O decomposes - up to a set of measure zero - into finitely 
many open orbits such that (Wl) - (W4) holds. More importantly, the structure of the 
group Q is relatively simple and well understood. In particular we have the following: 

(1) The map A x N x R 3 [a,n,r) ^-^ anr G Q is a diffeomorphism; 

(2) i? is a compact group and the stabihzer of u is contained in R; 

(3) A is abelian and A and R commutes; 

(4) Both R and A normalize the group A^; 

(5) Let 

a={X e M{n, M) I Vt G M : e*^ G A} 

be the Lie algebra of A. Then exp : a ^ A is an isomorphism of abelian groups, 
i.e., e^+^ = e^e"^ for X,Y e a; 

(6) Let 

n = {X G M(n, M) I Vt G M : e*^ G N} 
be the Lie algebra of N. Then exp : n — X is a diffeomorphism. 

We refer to [S] for the exact construction, but for completeness we recall some of the 
main constructions in the next section, but first we will show how those facts can be used 
to construct a separated set and a frame generator. The construction is very much in the 
spirit of Example 13.51 In fact we do not need the last conditions, so from now on we will 
assume that Q = ANR G GL(n, M) is a closed subgroup satisfying the conditions (1) - 
(5). 
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Let Hi, . . . , Hr he a. basis for o. For t G W let a(t) := exp(^^^^ tjHj). Let 

(4.1) Fa = {a(m) G A I m G Z''} . 

Then F^ is a discrete subgroup of A. If Fjv is a discrete subgroup of A'" let F = F^F^v. 
Then F is a discrete subset of AN, but in general F is not a subgroup. 

Theorem 4.1. Assume that Q = ANR is a closed subgroup o/GL(n,]R) such that (1) - 
(5) above holds. Suppose that Fjv is a discrete subgroup of N. Set F = FaFjv- Assume 
that O dW" is an open Q-orbit such that 0\0 has measure zero. Let cu E O and assume 
that — L (Z R. Then F is a separated set. 

Proof. For e > denote by the closed ball in n with center zero and radius e, = {X e 
n I Tr{XX^) < e}. Let = exp(S,). Choose e > such that exp : B^^ exp(SfJ is a 
diffeomorphism, and 

(4.2) K^nr^ {e}. 

Choose < 5 < 1/4 such that for \tj\ < S, j — 1, . . . ,r, we have 

(4.3) exp(a(t)fi,a(t)-^) = a{t)K,a{t)-^ C . 

This is possible because the action Axn3 {a,X) aXa~^ G n is continuous. For X G n 
let n{X) = exp(X). Define (using the obvious notation) 

B{Q) = {a{r)n{X)b \ \rj\ < S, X e B„ b e B} C Q . 

Then B{Q) is compact with B{Qy ^ 0. 

Assume that we have gi = 71^71,(72 = 'J2V2 £ T, 7j G and rjj G Fat (j = 1,2), 
such that giB{Q) fl g2B{Q) ^ 0. Then we can find aj — a{rj) G {a{r) \ \rj\ < 5} C A, 
Uj = n{Xj) G {n{X) \ X G -Bj, and bj e B {j ^ 1, 2), such that 

7i77iaini6i = 72772a2ri2&2 ■ 

But then 

7iai((a5"^77iai)ni)6i = 7201(02 S2a2)ri2&2 ■ 

As the map Q — A x x i? (cf. condition (a)) we must have 7101 = 72^2, (Qr^'7i^i)'^i — 
{a2^rj2a2)n2, and bi — 62- Write 7^ = a{nij) with mj G {j — 1,2). Then 

a(mi + ri) = a(m2 + r2) . 

As the exponential map exp : — > A is an isomorphism of groups (cf. (5)) it follows that 
111 — n2 = r2 — ri G Z'' fl {r G Z'" | \rj\ < 6} = {0}. Hence, ni = 112 and ri = r2. It follows 
that 7i = 72 and ai = 02. Let a = Oi = 02. Then we have 

a~^r)ian{Xi) — a~^r)2an{X2) 

or (by conjugating by a): 

771^(0X10"''^) = r]2n{aX2a'~^) . 
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Write T] = ^^T]! E T]y. Then we get 

r] = n{aX2a'^)n{-aX2a'^) eVOK^ = {e} 

by ()4.2|) and ()4.3|) . But then rji = ri2 and rii = n2 showing that B{Q) separate F in Q. 

Let k: Q-^0,p\-^p-uj = {p^^Y{ijj). Then K{pq) = p ■ ^{q). Then B := k{B{Q)) is 
compact and 5° = k{B{Q)°) 7^ 0. We claim that B separate F in O. For that assume 
that there are gi,g2 G F such that gi ■ B n g2 ■ B 0. Then there exists &i,&2 ^ -B(<5) 
such that gibi = (72^2- Then it follows that gi = g2 and, hence, the claim. □ 

Assume now that F^r is a discrete subgroup of such that F7v\A^ is compact. Choose 
Fn C N compact such that F^F^v = A^. Then ^ 0. Define Fa = {a(t) | Vj G 
{1, . . . , r} : \tj\ < 1} and 

¥q ■.= FaFnB eg. 

Then ¥q is compact and F" 7^ 0. Furthermore FFq = Q as F^F^ = A, F^v C {070"^ | 
a G Fa , 7 G Fjv}, and FivF^v = A^. 

Theorem 4.2. Assume that Q = ANR is a closed subgroup of GL{n,M.) such that (1) - 
(5) above holds. Suppose that F^r is a discrete subgroup of N such that Ti\i\N is compact. 
Set F = F^F^r and define Fg = F^Ftv-B as above. Assume further that O gMP is an open 
Q-orbit such that 0\0 has measure zero . Let uj E O and assmume that = L d R. 
Let F = Fq ■ cu. Then (F, F) is a frame generator. 

Proof. This follows from the discussion just before the statement of the Theorem. □ 

By condition (6) we see that the group A^ as constructed in is a simply connected 
nilpotent Lie group. We recall here the most general statement about the existence of co- 
compact subgroups of nilpotent Lie group, but first let us recall the following definition. 
Let be a Lie algebra and let {Xi, . . . , X^} be a basis for g. Then we can write 

r 

[Xj, Xj] = CijkXk . 

k=l 

The constants Cijk (1 < i,j, k < r) are called the structure constants of q relative to the 
basis {Xi, . . . , Xr}. 

Theorem 4.3 (Malcev, 1949). Suppose that N is a simply connected nilpotent Lie group 
with Lie algebra n. Then N contains a co-compact discrete subgroup if and only if n has 
a basis with rational structure constants. 

The following is also well known and follows from Theorem 14.31 See also |6j, p. 511, 
for proof. 

Theorem 4.4. Assume that N C GL(?t,,M) is unipotent (i.e., the Lie algebra is nilpotent) 
and defined over Q. Let Nz := N D GL(n, Z). Then Nz\N is compact. 

We notice also the following simple application of the ideas in the proof of Theorem 
14. II and Theorem 14.21 
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Lemma 4.5. Let H C GL(n, M) he a closed subgroup. Assume that O is an open H- 
orbit under the twisted action such that H'^ is compact for uo & O. Assume that 0\0 
has measure zero and that there exist a co- compact discrete subgroup T G H such that 
r n H'^ = {e}. Then there exits a compact subset ¥ G O such that (r,F) is a frame 
generator. 

Proof. Let F C if be a compact subset such that such that TF = G. 

□ 



5. Action of reductive groups 

In this section we recall the construction from [S] of the group Q. This in particular 
gives us a simple criteria for the existence of a co-compact discrete subgroup Fat in A^. 
We refer to pj for proofs. 

Definition 5.1. A closed subgroup H C GL(n,]R) is called reductive if there exist a 
X G GL(n, M) such that xHx~^ is invariant under transposition, a a^. 

We assume from now on that H is reductive. For simplicity we can then assume that 
= H. In order to handle cases where O = H ■ uj do not necessarily have compact 
stabilizers, we will assume that there exist an involution t : H H such that 

HIGH'' = {heH\ h^{u) =uj} gH^ 

where 

H^ = {heH\ T{h) = h} 

and the subscript "o" indicates the connected component containing the identity element. 
Notice that the involution r may depend on the open orbit. We can assume that L is 
also invariant under transposition. Then 9 : h ^ {h'^)~^ and r commute. Let K = 
0(n) n H = & H \ = Then is a maximal compact subgroup of H and 

L n is a maximal compact subgroup of L. Denote by f) the Lie algebra of H, i.e., 
l) = {X e M„(R) \ yt eR: e^^ e H}. Then [) decomposes as 

i) = t®3 
= i®q 

= en [©tnq©5n i®snq 

where 

s = {X e f) I = X} 

is the subspace of symmetric matrices, and 

q = {XEi)\ r(X) = -X} . 

Notice that 

[[, q] C q and [t, s] G s . 
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Even if we are not going to use it, we would also like to recall the isomorphism q ~ Tt^(O) 
given in the following way. For X & c\ define a derivation Dx by 

Dxif) ■■=Jtfi^'''-^)\t=o- 

Then q 3 X ^-^ Dx € Ti^{0) is a linear isomorphism. As L fixes 00 it follows that L acts 
on Ti_^{0). Denote by £h the map ih{v) — h ■ rj. Then for /i e L we have 

{di,UDx)f = ^/(/ie*^-a;)|i=o 

= i/(e*AdWW.u;)|,=o 

= DAd{h){X){f) ■ 

Hence, the action of L corresponds to the natural action of L on q. In particular it follows 
then that the tangent bundle T{0) can be described as the vector bundle T{0) = H x^q. 

Recall the linear maps Ad(a),ad(X) : f) — [), a G ^T, X G f), are given by ad{X)Y = 
XY — YX = [X, Y] and Ad(a)y = aYa~^. Let a be a maximal commutative subspace of 
5 n q; thus XY — YX — for all X, F G a. Then the algebra ad(a) is also commutative. 
Let (• I •) be the inner product on i) given by {X \ Y) :— Tr{XY'^). Then a simple 
calculation shows that (ad(X)r \ Z) ^ {Y \ ad(X^)Z). Thus ad(X)^ = ad(X^). In 
particular, if X G 5 then ad(X) is symmetric. It follows that we can diagonalize the 
action of a on [). Specifically, for a E a* set 

= {F G [) I VX G a : ad(X)F = a{X)Y} . 

Let A = {a G t)* I [)" ^ {0}} \ {0}. Notice that the set A is finite. Hence, there is a 
X^ G a such that a{Xr) ^ for all a G A. Let A+ = {a | a{Xr) > 0} and Let 

n= f)". 

Let mi = {X G [) I [a, X] = {0}}, and m = {X G nxi | VF G : (X | F) = 0}. Then mi = 
m © a. Furthermore m, n, and p = m © a © n are subalgebras of i) and 

i) = e + p 

= t + p. 

Notice that this is not a direct sum in general because i C] p = t (1 m and I fl p = I fl m. 
Let m2 be the algebra generated by m n s, i.e., m2 = [m fl s, m fl s] © m fl s. Then m2 is 
an ideal in m and contained in m fl t. 
Let 

r := {X G m I VF G m2 : (X, F) = 0} = m^. 
Then r is an ideal in m and m = r © m2. Let 

NK(a) = {A; G X I VX G a : Ad(a)X G a} 
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and 

NLnM = NK{a) n L . 

Finally let 

Mk = ZK{a) = {k e K \ \/X e a: aXa^^ = X} 

and 

Ml = Zlhk = Ln MK{a) . 

Then 

W = NK{a)/MK and Wq = NKnL{a)/ML C W . 

are finite groups For < j < A; = i^W/Wo choose Sj G Nk such that sq = e and by 
obvious abuse of notation 

W = [_JsjWo (disjoint union) . 

Let P = {aeH\ Ad(a)p = p}, A = {e^ | X G a } and = {e^ | X G n}. Then 
P, A, and X are closed subgroups of H, and A,N C P. Let M2 be the group generated 
by exp(m2), and Ro = exp(r). Then F = exp(za) fl X C Mk is finite and such that 
R = FRo is a group. Furthermore 

R X M2 X A3 {r, m, a) rma G Zh{A) 

is a diffeomorphism. Notice that by definition F is central in Zh{A) and mFm~^ = F 
for all m G Nxici)- Let M = RM2. Then P = MAN. Furthermore each element p & P 
has a unique expression p = man with m G M, a E A, n E N. The final step is now to 
define 

(5.1) Q := RAN = ANRc P. 

Then Q is a closed subgroup of H with Lie algebra q = r © a © n. Notice that P) = 
t + (r © a © n) and [ fi (r © a © n) = [ n r. 
By Theorem 4.3 in |H] we have the following: 

Theorem 5.2. Choose e = sq, si, . . . , Sk E W such that W is the disjoint union of the 
CO sets SjWo. Then 

[j^^fis.L C H 

is open and dense. Furhermore there exist an analytic function ip : H ^ C such that 

k 

H\[j QsjL = {heH\ i){h) = 0} . 
j=o 

In particular H \ IJj=o QsjL has measure zero. 
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Theorem 5.3. Let the notation be as above. Let O C M."- be an open orbit such that 
L — H'^ is a symmetric subgroup. Let Oj — Q • {sj • cu) . Then 

• k 

is open and 

o\\jIo,co 

has measure zero. Furthermore the stabilizer in Q of uj in Oj (1 < j < k) is compact. 

Example 5.4 (GL(n, R) acting on symmetric matrices). Let V be the space Sym(n.]R) of 
symmetric nxn matrices. Then V ~ M"("+^)/2 Under this identification the standard inner 
product on M"("+i)/2 corresponds to the inner product {X, Y) := Tr{XY) = Tr{XY^) on 
V. Define an action ol H — GL(n, M) on V by 

a{X) = {a-^fXa-^ . 

Then 

a- X ^a\X)^aXa^ . 

Each symmetric matrix is up to conjugation determined by the signature and rank. The 
set Vrcg = {X G V I det X 7^ 0} is open and dense in V and has measure zero. Furthermore 
each matrix in Vreg is conjugate to one of the matrices /(O) = /„, I{n) = —In or 




where 1 < p < n — 1. Denote the corresponding orbit by Op. Notice that X 1— > —X 
defines a GL(n, M) isomorphism Op ~ On-p. The group 0(p, n—p) is by definition given 

by 

0(p, n-p) = {ge GL(n, R) | gl{p)g^ = I{p)} 

where we use the notation 0(n) = 0(n, 0) = 0(0, n). Notice that S0(j9, n—p) is compact 
if and only if p = n. It follows that only the orbits Oq and On satisfy the condition 
(W4). As before we let 9 : GL(n,R) ^ GL(n,R) be the involution e{g) = {g~^Y . For 
j = 0, . . . , n we define Tp : GL{n, R) GL{n, R) by 

(5.2) Tp(g) = I{p)e{g)Iip) . 

Then 

Tp(^) = g gi{p)9^ = Kp) 

and, hence, 

H^^ = {ge GL(n, R) | T,{g) = g) ^ 0(p, n - p) = H'^^^ 

and hence the orbit Op ^ GL(n, R)/0(p, n — p) is a symmetric space. 

By abuse of notation we denote the derived involutions on M(n, R) by the same letters, 
i.e., 

e{x) = -x^ , Tp{x) = -i{p)x^i{p) . 
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Then ^(expX) = exp(^^(X)) and rp(expX) = exp(rp(X)). Define as in tlie last section: 

t = {X eM{n,R)\e{X)=X} = o{n), 

s = {X e M{n, R) I d{X) = -X} = Sym(n, M) , 

[) = {X eM{n,R)\Tj,{X)=X} = o{p,n-p), 

q = {X e M{n, R) \ rp{X) = -X} , 

wliere we leave out the dependence of f) and q on p as that should be clear in each case. 
Then 

0l(n,M) = t®5 

= tn {) ® t n q ® 5n f) ® sn q . 

In this case the abehan subalgebra a is given by: 

a = {d{ti, ...,tn) I ti, . . . ,tn e M} 

where d{di, . . . ,tn) = d{t) stands for the diagonal matrix with diagonal entries ti, . . . ,tn- 
In this case a is maximal abelian in s and in fact maximal abelian in 1^. Hence, the 
centralizer of o in t and [ is trivial. Thus we will have P — Q in this case. 
A simple calculation shows that 

[d{t), Eij] = {ti - tj)Eij , 

i.e., the matrices Eij arc the joint eigenvectors of {ad((i(t)) | d{t) G a}, with eigenvalues 
ti — tj. Define aij : o — * M by aij{d{t)) = ti — tj. Then A = {aij | 1 < J < i ^ 0}. 
Let A+ = {aij \ l<i<j<n}. Then n is the Lie algebra of upper triangular matrices 
with zero on the main diagonal: 

n= REij. 

l<i<j<n 

Furthermore A — exp(a) = {d{e^^, . . . , e*") = {d{t) \ tj > 0} and N — exp(n) is the group 
of upper triangular matrices with one on the main diagonal. So in particular AN is the 
group of upper triangular matrices with positive diagonal elements. In this case the group 
M is given by M = {(i(e) | €j = ±} ~ { — 1, 1}" and P = MAN is the group of regular 
upper triangular matrices. The group Nk{A) is the finite group of elements with only 
one coefficient non-zero in each column and row, and that non-zero element is either 1 or 
— 1. Let &n be the group of permutations of {1, . . . , n}. Then W acts on a by 

a ■ d{ti, . . . ,tn) ^ 0^(^(7-1(1)' ■ ■ ■ '^CT-i(n)) ■ 

Notice that this action can be realized as the conjugation by the orthogonal matrix 

^ij — i-^n — Eii — Ejj) + Eij — Eji e M' . 
It follows that 1^ ~ 6„. The group Lf] K — 0{p,n — p) r\0{ri) is given by 

L n X ~ 0{p) X 0{n - p) 



20 



G. OLAFSSON 



where the isomorphism is given by 

(o t) ■ 

Hence, Wq ^ 6p x ©„_p. In particular each of the open GL(?t,, ]R)-orbits is decomposed 
into p|(^lp)| -P-orbits. Finally we remark that in this example we can take 

= A^n GL(n, Z) 

the group of upper triangular matrices with integer coefficients and one on the diagonal. 

Remark 5.5. Examples of pairs (if, M") such that H is reductive and has finitely many 
open oribts of full measure is given by the pre-homogeneous vector spaces of parabolic type 
(see jS]). But there are simple examples where the stabilizer is not symmetric. For that 
let H = SL(2, M). Then H acts on in a natural way and the orbits are {0} and ]R^\{0}. 
Hence there is only one open orbit, and that orbit has full measure. The stabilizer of ei 
is the group 

which is not symmetric in SL(2,R). Let 

Then Q has three orbits {0}, {{0,y)'^ G | ?/ 7^ 0} and the open oribt O = {{x,y)^ e 
I X 7^ 0}. The stabilizer of ei e O is trivial and, hence, we can replace SL(2,M) by Q 
to construct frames. Notice that Q is isomorphic to the {ax + 6)-group. 

Remark 5.6. Assume that (if, R") is a pre-homogeneous vector space of parabolic type. 
Then one can show that the same group Q works for all the open oribts 0. Furthermore 
the group Q is admissible in the sense of Laugesen, Weaver, Weiss, and Wilson [12] and 
contains an expansive matrix. 
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